Holistic indoor scene understanding by context-supported instance segmentation
نویسندگان
چکیده
We propose a new method flow that utilizes pixel-level labeling information for instance-level object detection in indoor scenes from RGB-D data. Semantic and instance segmentation are two different paradigms scene understanding usually accomplished separately independently. interested integrating the tasks synergistic way order to take advantage of their complementary nature comprehensive understanding. Our work can capitalize on any deep learning networks used semantic by treating intermediate layer as category-wise local output, which is optimized jointly considering both spatial fitness relational context encoded three graphical models, namely, vertical placement model (VPM), horizontal (HPM) non-placement (NPM). VPM, HPM NPM represent common but distinct configurations: vertical, hanging relationships, respectively. Experimental results standard datasets show our significantly improve small with promising overall performance competitive state-of-the-art methods.
منابع مشابه
Holistic Scene Understanding
This report documents the program and the outcomes of Dagstuhl Seminar 15081 “Holistic Scene Understanding”. During the seminar, several participants presented their current research, and ongoing work and open problems were discussed. Abstracts of the presentations given during the seminar as well as abstracts of seminar results and ideas are put together in this paper. The first section descri...
متن کاملPixelLink: Detecting Scene Text via Instance Segmentation
Most state-of-the-art scene text detection algorithms are deep learning based methods that depend on bounding box regression and perform at least two kinds of predictions: text/nontext classification and location regression. Regression plays a key role in the acquisition of bounding boxes in these methods, but it is not indispensable because text/non-text prediction can also be considered as a ...
متن کاملContinuous Factor Graphs for Holistic Scene Understanding
We propose a novel mathematical formulation for the holistic scene understanding problem and transform it from the discrete into the continuous domain. The problem can then be modeled with a nonlinear continuous factor graph, and the MAP solution is found via least squares optimization. We evaluate our method on the realistic NYU2 dataset.
متن کاملFusion Based Holistic Road Scene Understanding
This paper addresses the problem of holistic road scene understanding based on the integration of visual and range data. To achieve the grand goal, we propose an approach that jointly tackles object-level image segmentation and semantic region labeling within a conditional random field (CRF) framework. Specifically, we first generate semantic object hypotheses by clustering 3D points, learning ...
متن کاملSupport surfaces prediction for indoor scene understanding
In this paper, we present an approach to predict the extent and height of supporting surfaces such as tables, chairs, and cabinet tops from a single RGBD image. We define support surfaces to be horizontal, planar surfaces that can physically support objects and humans. Given a RGBD image, our goal is to localize the height and full extent of such surfaces in 3D space. To achieve this, we create...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Multimedia Tools and Applications
سال: 2021
ISSN: ['1380-7501', '1573-7721']
DOI: https://doi.org/10.1007/s11042-021-11145-y